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Abstract. The paper presents a result which relates connectedness of the interaction graphs in a multi- 
agent systems with the capability for global convergence to a common equilibrium of the system. In particular 
we extend a previously known result by Moreau by including the possibility of arbitrary bounded time-delays 
in the communication channels and relaxing the convexity of the allowed regions for the state transition map 
of each agent. 

1 Introduction 

Recent years have witnessed a growing interest in the study of the dynamical behaviour of the so called 
multi-agent systems. Roughly speaking these can be thought of as complex dynamical systems composed by 
a high number of simpler units, the agents. Each of them updates its state according to some rule, whose 
Input-Output dynamics are typically much simpler and much better understood, and on the basis of the 
available information coming from the other agents. All of them, though not necessarily identical, share in 
fact some common feature of interest (say for instance a given output variable) and are coupled together by 
communication channels. The focus of the current research is precisely on how the global behaviour of the 
system, (for instance questions concerning the global stability or the overall synchronization) is influenced by 
the topology of the coupling on one hand (this is an analysis problem in many respects) or the dual question 
of how to induce a certain desired property of the ensemble based on some form of local coupling for the 
agents. Problems of this nature arise in many different fields, such as in the theory of coupled oscillators 
in neural networks p], in economics or in the manouvering of groups of vehicles For instance in [J] 
the so called rendezvous problem is considered, namely how to design a local updating rule, based on nearest 
neighbor interactions, which would ensure convergence of all of the agents to an unspecified common meeting 
point. Emergence of a global behaviour is therefore a consequence of the local updating rule, without the 
need for a leader nor of centralized directions being broadcasted. 

Despite the common traits, the most powerful results are obtained when specializing to systems of a 
given simple form. Hereby we take a slightly different approach. The emphasis is on how the topology of 
interconnections between agents (possibly time-varying) affects the convergence of all agents to a common 
equilibrium. This analysis will be carried out in the presence of limited transmission speed of the information 
between the agents. In particular, we propose an extension of the contributions by Moreau |B1IH], mainly in 
two directions: 

• The new setting allows the presence of arbitrary bounded communication delays. 

• A central assumption in the results [HUH], namely that the future evolution of the studied system is 
constrained to occur in the convex hull of the agents states, is removed. 
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The first aspect comes as a very natural question both from a practical and a theoretical point of view. 
Communication delays are in fact ubiquitous in the "real" world and it is well-known their potential desta- 
bilizing effect in conjunction with feedback loops, here induced by the graph topology of the communication 
channels which need not be of a hierarchical type. It is therefore remarkable to see how, at least in the 
specific set-up we are considering, this destabilizing effect does not take place and the same global behaviour 
of the multi-agent system in terms of convergence to a common equilibrium follows also in the extended 
set-up. 

The second extension deals with convexity issues; one of the technical tools used in order to enforce a 
common behaviour in systems whose state takes value in Euclidean space, is to have local evolutions point 
always inside the convex hull of all variables. This makes life easier in a certain respect but it is an un- 
natural assumption in more general contexts, for instance when oscillators networks are considered (these 
are typically modeled as systems evolving on a torus) or systems evolving in partially obstructed Euclidean 
spaces (for instance on a plane minus a circle). Relaxing convexity is meant as a first step in the quest for 
stability conditions which can work in more general spaces. 

Before going on further, we present the main elements of this construction, developed below. The multi- 
agent system under study will be described by a time- dependent graph A(t), describing the transfer of 
information between the agents at time t, and a set of rules according to which each agent updates its state 
at time t + 1. The definition of the latter is done by the introduction of two types of objects, which we 
present now (complete definitions are to be found in Section [21 below). 

• A set-valued map a, is defined, which associates to the set of present and past states of the agents 
a compact set in the state space common to all the agents. This map will play the central role of a 
set-valued Lyapunov function for the system. 

• It is then necessary to define the rules according to which the agents update their state, given the 
(possibly delayed) information on the position of the other agents they received. For this, each agent k 
is attributed a set- valued map which, given the communication graph A(t), defines the set of allowed 
positions ek(A(t)). An important point here is that, whatever the information received by each agent, 
the new positions cannot induce an increase of the set-valued Lyapunov function along the trajectories. 

The definition of the new class of multi-agent systems studied here is done and commented in Section [5] 
The stability is studied and the main results are given in Section |21 

Notations As often as possible, we use the notations introduced by Moreau [HI El • Following him, we 
distinguish between the inclusion, denoted C, and the strict inclusion, denoted C. The topological interior 
of a set is denoted int. 

We study systems with n agents whose position at time t are written as x±(t), . . . ,x n (t) in the finite- 
dimensional space X. In the setting introduced in Moreau's contributions, the corresponding overall state 
variable is x(t) = (xi(t), . . . , x n (t)) G X n . Here, we consider systems with delay smaller than a given 
integer h > 0. In consequence, the complete state variable of the system is (xi(t), x%(t — 1), . . . , x\(t — h + 
I), ■ ■ ■ ,x n (t), . . . ,x n (t — h + 1)) G X hn . 

We denote x — (xi, . . . , Xf ln ) an arbitrary element of X hn and, when considering the dynamical system, 
we write Xk(t) — (xk(t), Xk(t — 1), . . . , Xk(t — h+ 1)) for all k € Af = {1, . . . , «} and x(t) — (xi(t), . . . , x n (t)). 
We also use the corresponding decomposition of any element x of X hn as x = (x\, . . . , x n ) (which amounts 
to identify X hn to (X )"). When needed, any xu G X h is decomposed according to Xk = (xk.o, ■ ■ ■ , Xk,h-i), 
in such a way that for the variables of the dynamical systems under study Xk,j{t) = Xk(t — j), k G AT, 
j G H = {0, . . . , h — 1}. Similarly we denote by TiAf = {1,2,..., hn}. The previous notation is necessary, 
in order to be able to distinguish between the delayed and the actual values of the position of the agents. 
Coherently with the notations introduced above, we sometimes abbreviate Xk,o and write simply Xk- 

Last, given any x G X hn we often need to embed it on 2 X , according to the following rule: ir(x) = 
{x\, X2, ■ ■ ■ x n h}- In this way the state of the system is mapped to a finite collection of points in the X space. 
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Finally, for the comfort of the reader we indicate that the Theorems 1, 2, 3 and 5 in reference [5] are 
numbered respectively 4, 1, 2 and 5 in |10|. 



2 A class of multi-agent dynamical systems 

This section is devoted to the presentation of the dynamical system under study. We study here a special 
class of nonlinear difference inclusions with delay, that we write: 



Recall that Xk{t) represents the "position" at time t of the agent k. The evolution of the latter depends 
upon the complete system state x(t) (including delayed components), through the time- varying map ek(A(t)). 
For a trajectory of Ijljl. we call decision set of agent k at time t the value taken by ek{A(t))(x(t)). The speci- 
ficity of the problem lies in these maps: they depend upon the topology of the inter-agent communications, 
modeled by the graph Ait). 

The modeling of the communication network is presented below in Section 12.11 The construction of the 
decision sets inside which, given the communication network, each agent may update the value of its state, 
is made in Section Last, we provide some examples in Section l?"3l 

2.1 Inter-agent communications modeling 

The first ingredient of the construction is the family of continuous set-valued maps ek{A) : X hn =t X taking 
on compact values, and defined for k £ Af and any directed graph A. The latter will define, according to the 
position of the other agents, in which subset of X agent k is allowed to choose its future state. 

Here, we are concerned by information transfer from the past to the present. In other words, we need 
to consider graphs in X hn linking some past and/or present values Xk(t — j) of the states of an agent k to 
another agent I. This motivates the following adaptations of some notions of the graph theory. Recall that 
Af = {1, . . . , n}, ft = {0, . . . , h — 1}, where n is the number of agents and h—1 the larger transmission delay. 

Definition 1. We call directed graph with delays any subset A of (Af x TL) x Af satisfying ((fc, 0), k) £ A 
for all k £ Af. The elements of Af are called nodes and an element ((k,j),l) of A is referred to as an arc 
from k to I. A node k £ Af is said connected to a node I E Af if there is a path from k to I in the graph 
with delays which respects the orientation of the arcs. Given a sequence of directed graphs with delays A(t), 
a node k £ Af is said connected to a node I £ Af across an interval I CN if k is connected to I for the graph 
with delays \J teI A(t). 

Figure ^ provides an example of graph with delays. For the graph represented therein, agents 1 and 2 
are mutually connected and agent 3 is connected to 1 and 2, but neither 1 nor 2 is connected to 3. Notice 
that generally speaking there may exist more than one arc between two distinct nodes, and that a node may 
be connected to itself (via delayed values). 

Definition 2. Consider a directed graph with delays A and a nonempty subset C C Af. The set Neighbors(£, A) 
is the set of those nodes k £ Af \ C for which there is I £ C such that (at least) one arc from k to I exists. 
When C is a singleton {I}, the notation Neighbors(Z, ^4) is used instead of Neighbors ({I}, A). 

We impose to the maps the following assumption. 

Assumption A. For all k £ Af and all directed graph with delays A, the set-valued map eu is continuous 
and takes on compact values. Moreover, 



x k {t+l) £ e k {A(t))(x{t)) . 



(1) 



• e k (A)(x) = {x k } if {x. 



((i,j),k) £A} = {x k }; 



• e k (A){x) C ri a ({x k } U {x. 



((i,j),k) £ A}) otherwise. 
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Figure 1: An example of graph with delays for a system with three agents. 

The exact meaning and the properties of the set-valued ri a are the subject of Section 12.21 However, 
we may already make some remarks on the form of the right-hand side of the problem. Clearly Assumption 
1X1 implies that the evolution of each agent depends only upon the possibly delayed information received 
from its neighbors. The case where {xij : ((«, j), k) G A} = {x^} is realized when either the agent k has 
no neighbor and the set involved in the formula is empty or all the (possibly delayed) positions received 
from the neighboring agents are also equal to the present position Xk of agent fc; in this case, no motion is 
allowed. We shall see below that in the present framework the use by each agent of the present value of its 
own position is mandatory for stability, see counterexample in Example |SJ 

2.2 Construction of the decision sets 

The second ingredient necessary for the construction of the dynamical system under study is a set-valued 
map a : 2 X =t X, taking on compact values. It has a central role in the definition of the dynamics, and it 
will be shown afterwards (cf . in particular the proof of Theorem |2J) that it plays the role of a "set- valued 
Lyapunov function" for the studied system. 

In order to state the properties that a should fulfil, we have to introduce beforehand some notions. First 
of all, define S, a set of subsets of X in which a will be compelled to take on its values, as: 

S = {S C X : S compact and 3<p : X — > X, <p bijective, <p, tp~ l Lipschitz and <p(S) convex} . (2) 

Important consequences will proceed from the fact that a takes on values in 5, inherited from properties 
of S summarized in the following result (see proof of Lemma \I\'m Appendix). 

Lemma 1. Let S be defined by (J2J. 

1. for any S £ 5, the function dsix ^ 1 ) : S x S — » [0, +oo) defined as 

d s (x°, x 1 ) n-finf {length^) : ip : [0, 1] Lv ^f z s, V>(0) = x°, ^(1) = .t 1 } 

is well-defined and continuous. Define fx : S — > M + by: 

fi(S)= max d s (x°,x l ). (3) 

Then, for all S G S, 
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• fi(S) < +00. 

• /J,(S) = if and only if S is a singleton. 

• l-i(S) is at least equal to the (euclidian) diameter of S , and equal to this value if S is convex. 

• fi is lower semicontinuous in S , but nowhere continuous. 

2. for any S £ S, let if be as in and 

r±(S) = ip —1 (ri( V (S))) , 

where r±(ip(S)) designates the relative interior of the convex set f(S), i.e. its interior when regarded 
as a topological subspace of its affine hull. Then, for all S € S , 

• ri(iS) is independent of the choice of ip. 

• ri(S') = if and only if S is a singleton. 

• int S C ri S C S . 

• ri(iS) is the relative interior of S if S is convex. 

Lemma n permits to measure the distance between points of a set S € S "along the arcs". It permits to 
define extended notions of diameter and of relative interior, which coincide with the usual ones for convex 
subsets of X. By definition, we call "relative boundary" of sets S in S the following set: 

id(S) = S\ri{S) . 

Also, according to the definition of d$ in Lemma we define, for any subsets S' , S" of a set S in S the 
S-distance from S' to S" as: 

d s (S',S")= inf dsix^x 1 ) . (4) 
x°GS',x 1 eS" 

We now gather the properties that a must fulfil, and afterwards comment on their meaning and conse- 
quences. 

Assumption B. The set-valued map a : 2 X — > S is continuous with respect to the topology induced by 
Hausdorff metric. Moreover, the following should hold: 

1. S C o~(S) with equality if S is a singleton. 

2. a{S) -co a(S) for all S E 2 X . 

3. S' C S => o-(S') C a(S) for all S, S' £ 2 X . 

4- If S is not a singleton, for all x £ S, there exists T, x C rda(S) such that T, x n S ^ and x ^ S x . 
Moreover, if S' C cr(S): 

(a) if ri cr(S') D 0, then S' C T, x (and in particular, x S' ). 

(b) ifd s (S',E x ) > 0, then fi(a(S')) < fi(a(S)). 

5. fio a is continuous. 

Remark that at this point, the problem under study is fully understandable: our goal is to find stability 
conditions for systems defined by Q, where the maps ek verify Assumption lAl for a given map a fulfilling 
Assumption iBl and where the meaning of the relative interior ri has been defined previously by Lemma ^ 

Important consequences of Assumptions IBl II to IBI5I are now stated. We shall see further (see Theorem 
[IJ that Assumptions IBI1HBI3I are indeed sufficient to forbid increase along time of the natural set-valued 
Lyapunov function of the system. The additional Assumptions IBI4IIBI5I induce the strict decrease of the 
set- valued Lyapunov function (see Theorem [21 . 

We provide in the following lemma a direct consequence of Assumption II ill I 



5 



Lemma 2. Assume Assumvtion \13ll\ is fulfilled. Then, for any S C X we have: card S > 1 => ri o~(S) ^ 
and n(a(S)) > 0. 

Proof. By Assumption IBI 1 1 it follows from card S 1 > 1 that card <r(S) > 1. Since cr(5) is not a singleton, it is 
homeomorphic to a sphere of non-zero dimension. Hence, ri o~(S) ^ 0. Moreover, ji{a{S)) > diam(cr(S')) > 
0, since the euclidean diameter of a set vanishes if and only if the set is a singleton. □ 

We now come to the central hypothesis, stated in Assumption IBI41 This Assumption applies to arbitrary 
(but non trivial) groups of agents S, which may comprise indifferently true agents or "virtual" agents, viz. 
informations relative to the position of a true agent at previous sampling times. More closely, for each agent 
x, there exists a portion of the boundary of cr(S), denoted by E x , whose elements are irreversibly attracted 
outside of it when using information received from any agent not in T, x (such as x itself) according to the 
rule edicted in Assumption lAl The second part of Assumption IBI41 imposes that such an irreversible escape 
from E^ comes with a strict decrease of the diameter of the set-valued Lyapunov function of the system (for 
convex sets S, S' C X, S' C S implies fJ,(S') < /J.(S), but this is not true for general sets in S defined by 10)). 

Generally speaking, the set E^ looks like as an union of "faces" of rda(x) containing an extremity of 
each geodesic of maximal length in a(S) (that is of length equal to fi(a(S))), except the point x itself if it 
belongs to rda(x). Remark that sets E-^Ej, associated to different points x,y in S may be equal, and that 
the union of the sets "E x over ifS does not have to cover rda(S). 

Similarly to what happens within Moreau's setting, one has the following result. 

Lemma 3. Assume Assumvtions WlltBl A] be fulfilled. Then, card(5) > 1 card(iS f~l rda(S)) > 2. 

Proof. Let x G S. Since S is not a singleton, by Assumption lBI4l there exists T, x C rda(S) so that T, x CiS ^ 0. 
Let y S E x n S. Since y £ S we can apply the same property to y in order to conclude that there exists 
Ej, C rda(S) and such that E y n S ^ 0. Let z G E y n S. Since by assumption y ^ E a we have y ^ z. 
Therefore y and z both belong to S f) rda(S) and are different from each other. This completes the proof of 
the lemma. □ 

Last, notice that Lemma ^ and the continuity assumption on a implies that the map \i o V is already 
lower semicontinuous on X hn . Assumption IBI5I thus represents a slightly stronger regularity assumption. 



2.3 Examples 



We present here different examples and counter-examples of maps a fulfilling the properties previously 
defined. 

Example 1 (convex hull). In Moreau's work, a(S) is taken to be the convex hull of S, see Figure|2 One may 
check easily that Assumptions IBIll to IBI5I are all fulfilled. Here, the sets E x involved in Assumption IBI4I can 
be defined as follows: 

E x = x + max{£ : x + ct G a(S)}c , 

cerc CT(S) (x),|c|=i 

where TC a (s){x) denotes the Bouligand contingent cone to the set o~(S) at x (otherwise called tangent cone, 
as a(S) is convex here; see ^ pp. 176-177 and 219] for details). 

Example 2 (a different convex example). For a given basis ey, j — 1, . . . ,p of X, take 



a(S) 



T T 

mmei x, maxe, x 



T T 

mm e,„ x. max e„ Xj 



In this example, the convex hull is applied "componentwise", see Figure|3J Remark that conv(S') C o~(S) for 
this case, but this relation is not mandatory, see Example 0] below. 

In the example depicted on Figure 01 one may check that the choice consisting in taking for E x = 



u 



ceTC^s) (x), |c|=l' 



max{t : x + ct G cr(5)}c, fulfills the Assumptions. 



G 




Figure 2: The convex-hull, Moreau's set-valued Lyapunov function. 




Figure 3: Illustration of Example [3 
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Figure 4: Other convex examples of set-valued Lyapunov function, see Example [3J 



Example 3 (other convex examples). One may also define a(S) as the smaller set containing S and with 
boundary parallel to given p + 1 non-parallel hyperplans (where X = W), see Figure More precisely, let 
£ = conv(S') and ei, . . . , e p+ i be (p+1) vectors in X such that for some positive A e W +1 we have ^ Aj-e^ = 
0. The set cr(S) is a polytope defined as: {x G X : ejx < max^'eE ej^'j i = 1> • • • iV + l}> containing the 
points X\, . . . , x/j„. Symmetrically we may define a(x) ~ {x £ X : ejx > min^/gs e J x '> i = 1> • • • >P + !}• 
Similarly to what occurs in Example [21 one may take for Yi x the portion of the boundary obtained by 
following the vectors coming out from the tangent cone at x all the way to their extreme intersection point 
with the boundary of cr(S), and the Assumptions IBI1I_BI5I arc fulfilled. 

Remark that the smallest ball or the smallest hypercube containing S does not fulfil the requested 
properties. For instance the smallest circle containing a triangle never contains the smallest circle containing 
the shortest of its edges, which violates monotonicity of the map a. 

Example 4 (nonconvex examples). For any bijective transformation tp : X — > X which is Lipschitz together 
with its inverse, one may take 

a v (S) = ip- 1 (v(<p(S))) , 

where a fulfils all the Assumptions. In general o~ v (S) % conv(5) and is not convex: indeed, this latter 
property is not essential. Such an example of nonconvex sets is given in Figure obtained for X — M 2 , 

/2\ /l\ / A , , ( cosalHI 2 sina||x|| 2 \ „„. , , m 

*i = [ ) , ^ = ( 5 J ,** = - tf*) = [_ sin ^ r cosallxf J X > a ^ °-° 4 ' &nd ^ = COnV ( 5 )- 

Notice that, generally speaking, the systems generated along this principle are such that the map (p in 
© is identical for all the sets <j(S). The sets may be obtained as for Example up to transformation 
by (p. 

Example 5 (intersection of decision sets). When a, a' fulfil the properties stated above, an interesting issue 
is to see whether a n a' do. One verifies easily that Assumptions IBIIHBI3I are automatically fulfilled. The 
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Figure 5: An example of map <r giving rise to nonconvex sets. Notice that conv(S) % a(S), and that /j(a(S)) 
is larger than the diameter of conv(S'). 
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Figure 6: Map obtained by intersection of the maps from Figures |3 and 0] 



validity of IBI4I and LBI5I depends upon the configuration of the sets S^, T,' x corresponding to a and a'. In 
Figure is presented an example where the resulting map fulfills all the properties. 



3 Results 

Before stating the results of this paper, we recall the notions under discussion below, see [5] As in 
Moreau's papers, we call equilibrium point any element of the state space which is the constant value of an 
equilibrium solution. 

Definition 3. Let X be a finite- dimensional Euclidean space and consider a continuous set-valued map 
e : N x X X taking on closed values, giving rise to the difference inclusion 

x(t+l) £ e(t,x(t)) . (5) 

Consider a collection of equilibrium solutions of this equation and denote the corresponding set of equilibrium 
points by $. By definition, ip £ $ if and only if tp £ e(t, tp) for all t £ N. 

With respect to the considered collection of equilibrium solutions, the dynamical system is called 

1. stable if for each tp £ $, for all ci > and for all to e N, there is c\ > such that every solution £ of 
JSJ satisfies: if \C(ta) — tp\ < c\ then \C(t) — <p\ < <^2 for all t > to. 

2. bounded if for each tp £ $, for all c\ > and for all to £ N, there is ci > such that every solution £ 
of |J5J satisfies: if |C(^o) — f \ < c i then \C(t) — <p\ < C2 for all t > to- 

3. globally attractive if for each <p\ £ $, for all c\,C2 > and for all to £ there is T > such that 
every solution ( o/ satisfies: if |C(^o) — Pi \ < ci then there is <pi £ $ such that \£(t) — pi \ < Ci for 
all t>t Q +T. 
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4- globally asymptotically stable if it is stable, bounded and globally attractive. 

If c± (respectively C2 and T) may be chosen independently of to in Item 1 (respectively Items 2 and 3) then the 
dynamical system is called uniformly stable ( respectively uniformly bounded and uniformly globally attractive ) 
with respect to the considered collection of equilibrium solutions. 

Notice that the above notions are uniform with respect to all trajectories of (JSJ. 

We now state a first result on boundedness and (simple) stability, analogous to Theorem 2]. 

Theorem 1. Assume that AssumvtionsTM and \Blf[\IHy[ are fulfilled. Then the discrete-time system Q is 
uniformly globally bounded and uniformly globally stable with respect to the collection of equilibrium solutions 
x\{t) = • • • = x n (t) = constant. 

Proof. The proof of TheorernQJis based on the evolution of the following set-valued function V : X hn =4 X, 

V{x) = <j{-k{x )) (6) 

along the solutions of JIJ. The fact that 1 1— > V(x(t)) is non-increasing is stated in the following result. 

Lemma 4. Let x be a solution of equation p|. Then, for all t e N, 

V(x(t + 1)) CV(x(t)) . 

Let us first prove Lemma 0] For any k 6 TV, for any t E N, 

x k (t + l)ea{{x k (t)}U{xi(t-j) : ((», j), k) e A(t)}) C V(x(t)) 

successively by Assumption ^ and Assumption and one concludes the demonstration of Lemma 0] by 
use of Assumptions IBI31 and IBI21 The proof of Theorem^is then obtained as a direct consequence. □ 

In view of Lemma 0J one may now have a clearer understanding of the fact that the map a has a double 
role: it is necessary to define the flow, but also serves as a set-valued Lyapunov function of the systems. 
Indeed, Assumption lAl states that each agent has to remain in the set V(x(t)), of which it has only an 
imperfect knowledge, and does its best to come closer from the other agents it has detected (this is the 
meaning of the use of the relative interior). In particular, when no new information is received, the only 
possible choice is to stay at the same place. 

As detailed in Section 12.21 contrary to a, the map ri a is not monotone: violation of this rule may 
occur when S' C S and the cr-hulls <r(S),a(S') have different topological dimensions as spheres. Up to this 
subtlety, a consequence of Assumption lAl is that, in general, the larger the quantity of information received 
by agent k from its neighborhood, the largest the set of possible updates it may choose (see the monotony 
property in Assumption Irjl3|l . Although this may sound paradoxical at first glance, this increase of the 
decision possibilities is quite natural: it means that supplementary information either leads to make a choice 
which could have been done otherwise (it is ignored or makes more valuable the decision) or allows to adopt 
choices which would not have been done otherwise. The "subtlety" comes from the fact that, when the 
information available to an agent is poor, some decisions are taken which would not have been possible with 
richer data. For example, the possibility of staying in the same place, which occurs when an agent, say agent 

1, is isolated from the other world, disappears when the position of another agent located elsewhere, agent 

2, is received. However, the unique choice <r({xi}) = {x\} is then located "on the boundary" of the decision 
set ri a{{x\, X2}), see Lemma [3] 

The key result of the paper is now stated. It provides a necessary and sufficient stability condition for 
system which extends [HI Theorem 3]. 

Theorem 2. Assume that Assumptions^\and^^are fulfilled. Then the discrete-time system Q is uniformly 
globally attractive with respect to the collection of equilibrium solutions X\(t) = ••• = x n (t) = constant if 
and only if there exists T > such that for all to G N there is a node connected to all other nodes across 
[to,t + T]. 
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The uniformity which is meant in the statement of Theorems ^ an d [21 is with respect to time. One may 
check from the proofs that it is also valid with respect to the different trajectories of QJ. 

Proof of Theorem\^ (Only if.) The proof consists in an adaptation of the contraposition argument developed 
by Moreau |SJ Proof of Theorem 3] . Assume that for every T > there is to £ N such that the sequence of 
graphs with delays has no node connected to each other across the interval [to , t + T] . This implies that 
for every T > there is to € N and nonempty, disjoint subsets C\,C% CjV such that Neighbors A{t)) = 
Neighbors(£2 , -A(t)) = for all t G [to, to + T]. The proof of this fact consists in checking that the proof of 
[HI Theorem 5] holds also in the case of graph with delays as defined above in Definition 2] 
Let y,y G X and consider any solution £ of Q departing from initial data defined by: 

i=y V(fc,i)eAx«, 
Ck(t -j)l=y V(fc,j) e£ 2 x H, 

{ e <t({v, y}) V(fc, j) e (Af \ (C x u £ 2 )) x n . 

As in the proof of Theorem 5], we still have the same relation at time to +T+1, since Neighbors (£i,A(t)) = 
Neighbors(£2, A.(t)) = for all t G [to, to + T]. As the time T may be chosen arbitrarily large, this contradicts 
uniform global attractivity of (JTJ with respect to the equilibrium solutions X\(t) = ■ ■ ■ = x n (t) = constant. 

(If.) As in Theorem 3], the proof is based on a (strict) decrease property of the set- valued function V 
introduced in (JSJ). 

Let T > chosen as in the statement of Theorem |2 x an arbitrary solution of QJ, and to € N for which 
the values of Xk(t — j), k g Af, j S H are not all equal. For all k G A/*, define the integer- valued function 
afc(t), t > t , by: 

a k (t) = card {j'ejV: afj(t) G Sa; fc ( to )} . 

where is meant relative to the set S = Tr(x(t )). In words, this is the number of agents which at time 
t > to are still belonging to the critical portion of the boundary Ti Xh u y Assume by contradiction that at time 
ti > to a new agent x a enters T, Xk ( to ) which was not there at time t\ — 1 {x a (t\ — 1) ^ Yl Xk u \). Let S' denote 
the set of points in X used by x a at time t\ — 1 in order to update its state. Of course, by Assumption 1X1 S' 
comprises x a (ti — 1) itself. Moreover, by monotonicity of the set-valued Lyapunov function V, S' C o~(S). 
Now, by the updating ruleEI x a (ti) £ T, Xk (t } is only possible provided that ri(<r(S")) fl E Xfe (j D ) ^ 0, and 
therefore, application of Assumption IBl4al yields x a (ti — 1) G S' C S Xjfc ( to ), which contradicts what was 
previously stated. Hence, we can conclude that agents can only leave S Xfe (t ), but never get back in. In 
particular then, the functions a k satisfy the inequality: 

Vt G [t ,+oo),Vfc G Af, a k (t + 1) < a k (t) 

and 

a k (t ) =a k (ti) G Af: Xj(t ) eS Ik(io) } = {j G Af : x 3 (t) G S^ (to) } Vt G {t , . . . , h}. (7) 

On the other hand, if t > to is such that a k (t) = for a certain k in Af, then Assumption IBI4bl implies that 
fi(a(x(t))) < fi(a(x(to)))- An important step consists in showing that: 

t>t Q +T' ^3keAf,a k (t) <a k (t ), T' = h + T. (8) 

There are at most n different sets in o~(x(to)), and afc(to) < n — 1. Consequently, the repetition of the 
argument used to get implication (jHJ (if allowed) will yield: 

t > t + (n - l) 2 T' ^>3keAf, a k (t) = . 

As a consequence, the estimate: 

t > t + T" => /i(V(5(t))) < /i(F(5(t ))), T" = (n - 1) 2 T' , (9) 
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will be deduced from Assumption IBI4bl because ir(x(t)) being a finite set of points located in a (it (x (to))) \ 
^x fe (t )i is thus at a nonzero distance (more precisely a <7(7r(x(io)))-distance, see ijljl) from £ XJs ( to ). In order 
to get @, let us now prove ©■ 

1. Inequality JSJ is fulfilled if it holds for f < f + h + T. 

2. Otherwise, one has ct k (to + h + T) = cek(to) for all fc in TV" and, by virtue of J7J, the set Ck = {j £ M ■ 
Xj(t) £ £.^((0)} has not changed for t £ {to, . . . ,to + h + T}. 

Using the hypothesis in the statement of Theorem^ there exists an agent, numbered k, connected to all 
others across the interval [to + h,to + h + T]. By definition, the set £ Xfc ( to ) does not contain Xk(to), and, 
since Ck has not varied in time, then also Xk(t) g 1 Y, Xk ( to ) for t = to, . . . , to + h + T. Moreover, because of 
the connectivity property of the graph put in the statement, Neighbors(£fc, U te [t +h,t +h+T]A(t)) ^ 0. 
Let i £ Ck be such that Neighbors(i, U te [ to+ h.t +h+T]A(t)) \ Ck ^ 0, viz. an agent which over the 
time-interval [t + h,t + h + T] is receiving information from outside Ck- Clearly Xi(t n + h — 1) £ 
Y> Xk ( to ^, but Xj(io + h + T) G" £ Xfc ( to ), as Assumption IBI4al implies that elements in E x are attracted 
outside of it, as soon as they receive information from agents sitting outside ~E X . This yields finally: 
ctk {to + h + T) < a.k(to) for the value of k previously exhibited. Inequality JSJl is thus proved. Of course 
this is true only as long as E Xf .( to ) is non-empty to start with. 

One verifies easily that the same argument may be used recursively, because the sets T, Xk ^ ta ^ may be kept 
unchanged as long as ctk{t) > for all fc G M. Thus, © is proved. 

Considering now x(io) £ X hn as a variable, let 

P(x(t )) = inf ft (>(C(0))) - n (V(C(T"))) . 

where the infimum is taken over all sequences ((1), . ■ ■ , C(T") in X hn such that ^(0) = x{to) and, for all 
t = 1,...,T", for all k £ J\f, 

Cfc,o(*) e e k {A{t + t)){((t - 1)) and ( ktj (t) = Cfej-iC* - 1) for j £ H \ {0} . 

The meaning of the previous line is precisely that the infimum is computed over all possible trajectories of 
the difference inclusion QJ. Now, the collection of ((t) £ X hn , t = 1, . . . , T" satisfying the previous condition 
is nonempty and compact for all initial value x(to) £ X hn . Indeed, by Assumption^] the set-valued functions 
ek(A) are continuous and take nonempty, compact values. 

The quantity to be minimized is strictly positive when the hn components of £(0) are not all equal, 
due to the strict decrease property of V established above and Assumption IBI4I Also, the expression to be 
minimized is lower semicontinuous with respect to C(l)i ■ • ■ ,C(T"), as V is continuous (by Assumption lB|l 
and fi is lower semicontinuous (by Lemma^l. Thus, /?(x(io)) > 0, except if all the components of x(to) are 
all equal. In other words, (3 is definite positive with respect to {x E X hn : X\ = • ■ ■ = Xhn}- 

By Assumption IBI5I the map X hn — > !L + , x i— > /i(V(x)) is continuous. The proof of Theorem[21is then 
achieved as for Theorem 3], by use of a result on set- valued Lyapunov functions. The latter, Theorem|21 
is an extension of [S] Theorem 1] to differential inclusions, given in Appendix. □ 

Example 6. The necessity for each agent to take into account the present values of its own position may be 
seen by the following counter-example. We take n = 3 and h — 2. Let 

A(2t) = (((2, 1), 1), ((1, 0), 2)), A(2t + 1) = (((2, 1), 3), ((3, 0), 2)) . 

In other words, agent 2 sends alternativaly to agent 1 and 3 the value of its position at the previous instant, 
and receives in the same time the present value of their position, see Figure Assume the agents use at 
time t the value of their position at time t — 1 to elaborate the update applied at time t+1. Clearly, for the 
corresponding graph with delays, the agent 2 is connected to all other agents across any interval [t,t + 1]. 
However, one sees easily that provided that the agents 1 and 3 are located initially at different positions, the 
positions of agent 2 at even and odd times tend in general toward two different values. As indicated by the 
existence of periodic motions, the strict decrease of the map 1 1— > [i(V(x(t))) may fail. 
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xi(t- 1) 
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-x 2 (t-l) \ 
- x 2 (t) 
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Agent 1 



Agent 2 
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Figure 7: Graph with delays representing the information flow for Example even (dots) and odd (dash) 
times. 

Appendix A — Proof of Lemma [1] 

1. We first recall that the length of a Lipschitz arc defined on [0, 1] is equal to 



length(-0) 





dtp 


/o 


dX 



dX 



Notice that, by Rademacher's theorem, ip Lipschitz implies differentiability almost everywhere, and therefore 
the previous integral is well defined. Let x ,x x £ S. Taking ip : X — ► X as in define the map 
ip : [0, 1] -► X 

iP(X) = if- 1 ((1 - X)ip(x°) + Xip(x 1 )) . (10) 

As ip(S) is convex, -0 maps [0, 1] in S. Moreover, due to the regularity assumption on ip, it is a Lipschitz 

arc, and V(0) = x°,ip(l) = x 1 . Thus the set jlength(^) : ip : [0, 1] Li ?f^ itz S,ip(0) = x°,ip(l) = x x | is 

non-void, and the definition of the map ds(x°, x 1 ) given in the statement is meaningful. 

Let us show its continuity with respect to x°, x 1 £ S. Let (x°, x 1 ) £ S x S. Consider a sequence (x £ ) £> q 
of elements of S tending towards x°. Let ip E \° be a fixed Lipschitz arc linking x E to a; . For any piecewise 
Lipschitz arc ip ^ 1 linking x° to x 1 , one may construct by concatenation of -0 e '° and -0 ' 1 another Lipschitz 
arc ip £][1 linking x £ to x 1 . One has 

length(^ e|1 ) = length(V/'°) + length(?/; 011 ) , 

so 

dsix^x 1 ) Kdsix'^^+dsix^x 1 ) . 

Arguing similarly, one gets that \ds(x £ , x 1 ) — ds(x , x )| < ds(x e ,x°). 
On the other hand, one may take ip as in i|l(J|) . in such a way that 



inf |length(-0) : ip : [0,1 



Lipschitz 



S,iP(0) = x s ,iP(l) = x } 



< 



dtp 



dX 



which shows the desired continuity property. 

Defining fi(S) as in one has fx(S) < +oo, because the image of a compact set by a continuous function 
is bounded. Moreover, if fi(S) — 0, then, for any (a; , x 1 ) £ S x S, the length defined by the map ijj in (fTU|) 
is zero, that is x° — x 1 and S is a singleton. Conversely, if S is a singleton, then fj,(S) = 0. Last, for any 
Lipschitz arc ip linking x° to x 1 and defined as in i|10|) . 

Ix'-x 1 ]] , 



/' 


dip 


■dX > 




10 


dX 
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and this shows that n(S) is at least equal to the maximal euclidian distance between two points of S, that 
is its diameter. The equality when S is convex is straightforward, taking the identity for ip in l|10|) . 

We now prove the lower semicontinuity of fi. Let S G S, and a sequence of sets S n G S tending towards 
S for the topology induced by Hausdorff distance. Our goal is to prove that: 



limmfn(S n ) > fi{S) 



(11) 



Obviously, in order to establish inequality (| 1 1 p . it is sufficient to consider only sets S n such that n(S n ) is 
bounded from above by a given constant, say by twice the value of n(S). Let e > 0, and consider two 
arbitrary sequences a;^ , G S n and a sequence of Lipschitz arcs ipn linking x® n to x\ in S n and of length at 
most equal to ds„ (x° , x„) + e. We thus have: 



liminf ds n (xf,,xl) + e > liminf length(-0 n ) > liminf dsAx®, xt] 

n — >+oo n — >+oo n — >+oo / 



(12) 



However, due to the previous remark on the boundedness of the sequence /i(S* n ), one may assume without 
loss of generality that the arcs ip n are covered with a rate of variation H^dtHl 00 um formly bounded. Indeed, 
if this is not the case, replace ip n by the map ip n defined by 



i>n=^nOe-\ 6[t) 



Jo 


dip n 
d\ 


■dX 


Jo 


dip n 
d\ 


■dX 



The map ip n has the same image and length than ip n , but the norm of its derivative is equal almost everywhere 



on [0, 1] to the constant J* 



dX 



■ dX. In particular, 



liminf length(^ n ) = liminf length(^„) 

n — > + oo n — > + oo 



(13) 



The arcs considered at this stage are thus equicontinuous. By compactness, one deduces that there exist 
subsequences (denoted similarly x„,x„ and ipn) such that 

x Q n -> x" G S, x\ -> x 1 G S, -0n $ G LipschitzQO, 1];S) . 

In particular, since by Arzela-Ascoli ip n — * tp uniformly over compact sets, we also have length(^ ra ) — > 
length(-0). Thus, since /J,(S n ) > d$ n (x^ , cc„), we have: 



lim inf fi{S n ) + e > lim ds n {x° n , x ) + e 

n — > + oo n — >+oc 

> lim inf length.(^/) n ) = length(-0) 

n — ' + 00 



> dsix^x 1 ) 



(14) 



By arbitrariety of e: 



liminf n(S n ) > ds(x°, x 1 ). 

n — >+oo 



We finally use arbitrariety of x° ,x l in S (arbitrary converging sequences in S n yield arbitrary limit points 
in S since S n — * S) to conclude liminfn^+oo fj,(S n ) > fJ-(S). The lower semicontinuity of fi is demonstrated. 



2. To prove that the definition of ri(S') is independent of ip amounts to show that: if the image of a convex 
set S by a bijective bi-Lipschitz map / : X — > X is a convex set, then the image of the relative interior ri(5) 
is the relative interior of the image of S. Let x G ri(5). Consider the restriction of / to the affine hull ah(S) 
of S. The set ri(5) is convex, thus there exists a convex neighborhood V C S of x in ah(S). By continuity 
of the image of F through / is a neighborhood of f(x) in /(ah(5 1 )). By hypothesis, is convex, thus 
there exists a convex neighborhood W C /(5 1 ) of f(x) in ah(/(5')). Now, the intersection f(V) fl W C /(5 1 ) 
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is a neighborhood of f(x) in ah(/(5)), so /(ar) G ri(/(5)). Wc thus get ri(5) C /- 1 (ri(/(S'))), and one 
shows similarly the converse inclusion. 

Let S E S. If ri(5) = 0, then ri(ip(S)) = and S is a singleton. Conversely, if S is a singleton, ip(S) is 
also a singleton and r±(tp(S)) — 0. 

It is clear that ri (S) C S. Also, the fact that int ((p(S)) C ri (tp(S)) C implies that 

int S 1 = int t^ -1 (tp(S)) C yj _1 (int (^(S*))) (as i^ -1 is continuous) 
C ^ _1 (ri 0(5))) = ri (5) (by definition of ri (5)) . 

Last, when S is a convex set, one may take for ip in J2} the identity, and this proves that in this case 
ri(5) is equal to the relative interior of S. 
This ends the proof of Lemma 



Appendix B — Stability based on set-valued Lyapunov functions 

The following result is an adaptation of 8, Theorem 1] to difference inclusions. For sake of completeness, a 
proof is provided, intimately linked to the proof of Moreau's result. 

Theorem 3. Let X be a finite- dimensional Euclidean space and consider a continuous set-valued map 
e : N x X ^ X taking on closed values, giving rise to the difference inclusion (J3J). Let 5 be a collection 
of equilibrium solutions and denote the corresponding set of equilibrium points by $. Consider an upper 
semicontinuous p. 1^1] set-valued function V : X X satisfying 

1. x G V(x),Wx G X; 
2- |J V{y) C V(x),Vt e N,Vx G X. 

3/£e(t,x) 

If V((f>) = {</>} for all 4> G $ then the dynamical system is uniformly stable with respect to $ 
bounded for all x G X then the dynamical system is uniformly bounded with respect to $. 

Consider in addition a function [i : Image(V) — > R>o and a lower semicontinuous function (3 
satisfying 

3. /i o V : X — > K>o is bounded uniformly with respect to x in bounded subsets of X ; 
4- /3 is positive definite with respect to $ that is, f3(4>) = for all 4> G $ and (3(x) > for all x G X \ $; 
5. sup n{V{y)) - (J,(V(x)) < -/3(x),Vt G N,Vir G X. 

y£e(t,x) 

If V((f>) = {(/)} for all G $ and V(x) is bounded for all x E X then the dynamical system is uniformly 
globally asymptotically stable with respect to $. 

The results stated above remain true if, for a fixed r G N, the decrease relations in 2. and 5. occur 
between V(yi+i) and V(yi), i = 0, . . . ,r — 1, yo = x, y r = y, instead of V(y) and V(x). 

Proof. (Uniform stability.) Consider arbitrary tp G $ and C2 > 0. If V((p) — {ip} then, by upper semicon- 
tinuity of V, there is c\ > such that V(x) C B((p,C2) for all x G B(cp,ci). Consider arbitrary to G N and 
.To G £?(<p, ci) and let £ denote any solution of inclusion (jSJ with C(to) = xq. Conditions 1 and 2 of Theorem 
pimply that, for all t > t , 

C(*)e |J V(y) CV(x Q ) c% )C2 ) . 

(Uniform boundedness.) Consider arbitrary <^ G $ and ci > 0. If V(x) is bounded for all x G X then, by 
upper semicontinuity of V, there is ci > such that U(ir) C B(ip, C2) for all x G -B(</?, ci). Consider arbitrary 
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to £ N and xo £ B(ip, c\) and let £ be any solution of JSJl with C(^o) = ^o- Conditions 1 and 2 of Theorem[21 
imply that for all t > to, 

C(t)e |J ^cF^cBfecs). 

yGe(t,a; ) 

(Uniform global asymptotic stability.) It remains only to prove uniform global attractivity with respect 
to 5. 

Consider arbitrary and c\ > 0. If V(x) is bounded for all x £ X then, by upper semicontinuity of 

V, there is a compact set K C X such that V(x) C if for all x £ B(<pi, c\). Similarly as above, Conditions 
1 and 2 of Theorem [21 imply that every solution of (0 initiated in B(<pi, c\) remains in K . 

Consider in addition arbitrary ci > 0. If V(tp) = {if} for all tp £ $ then, by upper semicontinuity of V, 
there is C3 > such that for all x £ £?($ n K, C3) there is (^2 £ $ such that C B(if2, C2). Similarly as 

above, Conditions 1 and 2 of Theorem [3] imply that every solution of (J5J entering n if, C3) remains in 
a C2-ball around some equilibrium point 1^2 £ 

It remains to prove the existence of T > such that every solution of J5J starting in £?(y>i,ci) cannot 
remain longer than T subsequent times in K without entering n K, C3). In agreement with Conditions 
3 and 4 of Theorem [21 and the lower semicontinuity of /3, we introduce two real numbers: 

M = sup fi(V(x)) < 00 and A = min /?(#) > . 
xeB(vi,ci) " xeK\B(*,c 3 ) 

Let T > be such that TA > M. Consider arbitrary to £ N and xo £ B(y>i,ci) and let ( denote any 
solution of JSJ with C(*o) = ^o- Then Condition 5 of Theorem [21 implies that for some t\ £ [foi^o + T], 
C(*i) £ S($ (~l X, c 3 ), since otherwise C(i) £ K \ B($, c 3 ) for all t £ [i , to + T] and 

/i(U(C(to+T))) </i(K(C(*b)))-T min < M - TA < , 

xeif\fl(#,c3) 

contradicting that /i takes only non-negative values. Putting everything together, we conclude that for some 
ip 2 £ $ and for all t>t + T, 

C(t) £ V(C(t)) £ /*(V(C(*i)) c B(^ 2 , c 2 ) . 

This achieves the proof of Theorem [21 □ 
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